An analysis of multimodal cues of interruption in dyadic spoken interactions
نویسندگان
چکیده
Interruptions are integral elements of natural spontaneous human interaction. Both competitive and cooperative interruption serve a distinct role in the flow of conversation. This paper analyzes their differences with features, change and activeness, employing audio, visual, and disfluency data. These features are able to capture differences between the two types of interruptions better than average feature values of any single modality. Also, discriminant analysis shows that the use of multimodal cues provides a 21% improvement in classification accuracy between the two types of interruptions relative to the baseline while any individual single modality cue does not provide significant improvement.
منابع مشابه
Acoustic and Visual Cues of Turn-Taking Dynamics in Dyadic Interactions
In this paper we introduce an empirical study of multimodal cues of turn-taking dynamics in a social interaction context. We first identify pauses, gaps and overlapped speech segments in the dyadic conversation dataset. Second, we define two types of measurements, Mean Equalized Energy (MEE) and Animation Level (AL) on the audio and video channels, respectively. Then, we verify the hypothesis t...
متن کاملAnalysis and Predictive Modeling of Body Language Behavior in Dyadic Interactions From Multimodal Interlocutor Cues
During dyadic interactions, participants adjust their behavior and give feedback continuously in response to the behavior of their interlocutors and the interaction context. In this paper, we study how a participant in a dyadic interaction adapts his/her body language to the behavior of the interlocutor, given the interaction goals and context. We apply a variety of psychology-inspired body lan...
متن کاملAn investigation into the frequency of Language Related Episodes in the EFL learners’ Homogeneous and Heterogeneous Dyadic Interaction
This study attempted to compare the relative frequency of the occurrence of Language Related Episodes (LREs) in the dyadic talks of pairs who were homogeneous and heterogeneous in terms of English proficiency. LREs are those parts of the conversations where the interlocutors explicitly focus on linguistic form. The study was carried out with 60 Iranian university students of teaching English a...
متن کاملSocial Network Extraction and Analysis Based on Multimodal Dyadic Interaction
Social interactions are a very important component in people's lives. Social network analysis has become a common technique used to model and quantify the properties of social interactions. In this paper, we propose an integrated framework to explore the characteristics of a social network extracted from multimodal dyadic interactions. For our study, we used a set of videos belonging to New Yor...
متن کاملCross-Subject Continuous Emotion Recognition Using Speech and Body Motion in Dyadic Interactions
Dyadic interactions encapsulate rich emotional exchange between interlocutors suggesting a multimodal, cross-speaker and cross-dimensional continuous emotion dependency. This study explores the dynamic inter-attribute emotional dependency at the cross-subject level with implications to continuous emotion recognition based on speech and body motion cues. We propose a novel two-stage Gaussian Mix...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2008